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Accredited universities normally in¬ 
clude a standard that addresses faculty evalu¬ 
ation. It may contain references to perfor¬ 
mance criteria and procedures and usually 
emphasizes the need for faculty evaluations 
to be systematic, regular, fair, objective and 
relevant to achieving the goals of the institu¬ 
tion. Accredited language programs usually 
have a similar standard that addresses in¬ 
structor evaluation. However, quite often per¬ 
formance criteria are never spelled out and 
teacher effectiveness is measured only by 
student appraisals of the course and the in¬ 
structor. Public K-12 programs normally 
have agreed upon standards, but schools all 
too often measure teacher effectiveness sole¬ 
ly by student test scores. The research is very 
clear that neither of these constitutes a fair 
and relevant evaluation. Teaching large 
groups of individuals with varied skills and 
backgrounds in diverse settings is not easy 
and neither is measuring its effectiveness. 

An effective evaluation system needs 
to entail more than student test scores and 
appraisals. It needs to include professional 
standards with performance criteria and indi¬ 
cators spelled out and endorsed by the lan¬ 
guage teachers, tools and procedures for self- 
assessment, peer mentoring, mentor coaching 
and supervisor evaluation as well as proce¬ 
dures and suggestions for other types of re¬ 
ports and evidence of teacher performance. 
The aim is to create an evaluation system that 
promotes teacher growth and gathers evi¬ 
dence for making high-stakes decisions. 

Purposes of Evaluation 

There are two types of teacher evalu¬ 


ations: summative and formative. Summa- 
tive evaluation measures and rates teachers. 

It is used for determining promotion, tenure, 
merit raises, awards, and dismissal. Forma¬ 
tive evaluation focuses on teacher develop¬ 
ment and improvement (Marzano, 2012). In 
formative evaluation, teachers are 
“participants in, not recipients of, their own 
evaluations” (NYSED, 2012. p. 3). The goal 
in formative evaluation is improving instruc¬ 
tional practices and continuing growth as a 
professional. It is collaborative in nature and 
promotes critical self-reflection and goal¬ 
setting. Formative evaluation systems are 
modeled after clinical supervision, which 
Mosher & Purpel (1972, p.78) define as “the 
improvement of instruction.” Clinical super¬ 
vision is multi-directional, supportive and 
constructive, and emphasizes making posi¬ 
tive changes in teacher effectiveness. 

Research suggests that the two types 
of evaluation be kept separate (Marzano, 
2012; Rindler, 1994; Felder & Brent, 2004) 
and that teachers be made fully aware of 
which type of evaluation is taking place, 
who will see the reports and where they will 
be stored. Programs need to determine which 
procedures and tools are for summative eval¬ 
uation and which are for formative evalua¬ 
tion. Where formative evaluations and pro¬ 
cesses are used and do not overlap with sum¬ 
mative evaluations, teacher growth is more 
likely to occur (NYSUT, 2011; Rindler, 
1994). 

Implementation of an evaluation sys¬ 
tem must include trust and respect between 
teachers and evaluators. If formative 
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evaluations are used for making accountabil¬ 
ity decisions rather than for improving teach¬ 
ing over time, trust and respect will be un¬ 
dermined. Instead of building a culture of 
growth, a culture of fear will be established. 
No one will want to reflect on and share 
their weaknesses and areas for improvement 
if the evaluation is being used to determine 
pay raises, or worse, dismissal (Rindler, 
1994). 

In general, beginning-service teach¬ 
ers are best evaluated through formative as¬ 
sessment and given time to reflect and make 
changes as needed. When it is time to do 
summative evaluation, teachers need to be 
informed ahead of time and the expectations, 
process, and tools to be used in evaluating 
made clear. The goal 
is to maintain a clear 
delineation between 
formative and sum¬ 
mative assessment (Rindler, 1994). 

Professional Standards and 
Performance Criteria 

Research supports the need for estab¬ 
lishing clear teaching and professional de¬ 
velopment standards that teachers under¬ 
stand and endorse prior to implementation 
(Rindler, 1994; Heneman et al, 2006; Dar- 
ling-Hammond, 2012). Having standards 
does not mean instituting standardization. 
Effective, sustainable standards invite diver¬ 
sity (Hargreaves & Fink, 2004). We want 
teachers who are creative and innovative in 
designing lessons and materials and in solv¬ 
ing problems and meeting challenges. We 
want teachers who meet the students where 
they are and move them forward in their 
English proficiency and language skills. But 
we also recognize the broad and deep body 
of research that describes what makes a 
teacher effective and how language is best 
taught and learned. 


Multiple measures should be used to 
get a full picture of a teacher’s performance 
(Theall, 2002; Felder & Brent, 2004; CTL, 
Uof NC, 1994, Rindler, 1994), understand¬ 
ing of language teaching and learning, and 
overall professionalism, but without over¬ 
burdening teachers or evaluators. Different 
types of evidence are needed for establishing 
whether different standards are being met. 
These are the biggest challenges in creating 
an effective teacher evaluation system. If the 
aim is teacher growth and improvement, 
then making expectations clear, and setting 
achievable goals and a reasonable timeframe 
is essential. 

Evaluation Procedures 


Before any evaluation 
procedures take place, 
as noted above, teach¬ 
ers must be informed 
of and endorse the standards that describe 
effective language teachers and teaching, 
and be familiar with the instruments used for 
the evaluations. Felder and Brent, (2004) and 
Rindler (1994) and also suggest that if teach¬ 
er development is the objective, then provid¬ 
ing opportunities for self-evaluation and peer 
feedback as well as collecting student ap¬ 
praisals and supervisor evaluations is im¬ 
portant. No matter who is doing the evalua¬ 
tion, formative evaluation should always be 
kept confidential. 

Self-Assessment 

An important aspect of formative as¬ 
sessment to promote teacher development is 
the opportunity for teachers to reflect on 
their own teaching, to self-assess and discuss 
their findings with peers, mentors, supervi¬ 
sors or teaching consultants without fear of 
these being misused in high-stakes decision¬ 
making. Self-assessment should be systemat¬ 
ic, not haphazard. “It requires discipline and 


The aim is to create an evaluation 
system that promotes teacher growth. 


2 


ORTESOL Journal 




perseverance, but the results are worth 
it” (Brown, 2007, p. 492). 

A logical first step in self-assessment 
is to have teachers rate themselves on the 
standards. Teachers should be encouraged to 
identify one or two specific elements they 
would like to improve (Brown, 2007). They 
should then monitor those elements, set spe¬ 
cific goals to change behavior, identify steps 
to meet their goals, and collect evidence to 
assess progress. Taking time to reflect and 
record, or discuss, the self-assessment is im¬ 
portant for synthesizing what was learned 
and for making real changes. More experi¬ 
enced teachers may need to focus on ad¬ 
dressing the questions, “What am I doing 
that I've probably done the 
same way for too 
long?” (Weimer, 2013, p. 

1), ‘How can I update and 
challenge myself?’, ‘What have I avoided 
learning more deeply?’ 

After that, teachers may identify one or 
two specific performance criteria they feel 
they might improve. Examples include: in¬ 
crease knowledge of theory and best practic¬ 
es in teaching speaking; implement the use 
of technology appropriately and effectively 
in instructional activities; increase the 
amount of student-talk vs. teacher-talk; de¬ 
velop and implement routines to manage ac¬ 
tivities and transitions; maintain clear stand¬ 
ards for student behavior; and build commu¬ 
nity in the classroom - whatever a teacher 
identifies as an aspect of his or her teaching 
that could be improved or updated. 

Goals can also grow out of infor¬ 
mation gained through self-recorded videos 
of lesson delivery, peer mentoring, or a men¬ 
tor coach’s or supervisor’s observations. 
Teacher development is multi-faceted and 
multi-directional. Information sought and 
gained can come from multiple sources. 


Peer Mentoring 

Felder and Brent (2004, p. 201) cau¬ 
tion that peer evaluation needs to be careful¬ 
ly constructed, that “a single observed class 
may not be representative of someone’s nor¬ 
mal teaching,” and that teachers may have 
very different ideas of what good teaching 
looks like. Although the latter can be dealt 
with by having clear standards that everyone 
understands and endorses, teachers still need 
to feel that the purpose of peer mentoring is 
not to judge, but to support professional 
growth. 

Feedback from teachers who have participat¬ 
ed in peer mentoring is often quite positive. 

Teachers frequently come 
away from the experience 
with greater insight about 
teaching and appreciation 
for the diverse ways in which material can 
be covered (Huston & Weaver, 2008). The 
observing teacher often learns as much as, if 
not more than, the teacher being observed, 
garnering new ideas, staying fresh and 
sharpening skills (Brown, 2007). 

Peer mentoring is not about evaluat¬ 
ing, judging or rating. Having teachers rate 
one another can undermine trust and collegi- 
ality. Peer mentoring is about helping one 
another. This can be done by focusing on 
one or two aspects of a teacher’s instruction¬ 
al plans, lesson delivery, or classroom envi¬ 
ronment, discussing what it looks like, and 
how it might look different. 

Self-reflections can be used to help 
focus peer mentoring. Teachers identify 
some aspect they’d like a peer to pay atten¬ 
tion to during the observation. For example, 
the teacher might ask the peer mentor to note 
how she or he gives directions for an activity 
to students and to write down exactly what 
the teacher says and does when giving 
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directions. The peer mentor might be asked 
to make a map of teacher movement during 
class - where was the teacher during various 
parts of the lesson? Or the peer mentor might 
be asked to look at a lesson plan and give 
suggestions for scaffolding it through a grad¬ 
ual release model, and then observe how it 
played out in the classroom. 

Beddes et al. (2012) created and pre¬ 
sented a model for peer mentoring based on 
the work of Huston and Weaver (2008) as 
well as information from the National 
School Reform Faculty at 
www.nsrfharmony.org . They use the follow¬ 
ing approach for peer mentoring. First, 
teachers identify a partner for reciprocal peer 
coaching. They agree to give one another 
three hours of their time during the term: 30 
minutes for a pre-observation conversation, a 
one-hour focused observation (reciprocated), 
and a 30-minute post-observation discussion. 


During the 30- 
minute pre-observation 
discussion both teachers 
identify the focus area for 
their observation; they agree on a note¬ 
taking strategy (a map, a T-chart of teacher- 
talk and student-talk, etc.); and they set up 
ground rules such as where the observer will 
sit. Each teacher observes the other for an 
hour or more focusing just on the identified 
aspect and takes the agreed upon type of 
notes. The observer may also reflect and jot 
down ideas or suggestions if the other teach¬ 
er wishes to receive additional feedback. 

Teachers meet again in a 30-minute 
post-observation discussion to show the 
notes, discuss what was noted, and share 
suggestions. Having the discussion focus on 
both teachers’ focus questions helps avoid 
judgments and builds an environment of 
sharing discoveries and ideas. 


A common concern about peer men¬ 
toring is the amount of time it takes. Howev¬ 
er, three hours out of a term does not seem 
taxing. Vidmar (2006) suggests that since 
teachers pick the peer they want to work with, 
they can choose someone whose time sched¬ 
ule meshes well with their own, and that pre- 
and post-conferencing can be likened to tak¬ 
ing a coffee break together. Teachers could 
plan their lessons together as suggested by 
Zwart, Wubbels, Bergen, & Bolhuis (2009), 
and use this time to set a focus for an observa¬ 
tion. 

Mentor Coaching 

Mentor coaching is formative feed¬ 
back done by a supervisor, teaching consult¬ 
ant or a more experienced teacher colleague 
assigned to the role. Mentor coaching can be 
done much the same way as peer mentoring, 
though reciprocation may or may not be part 
of mentor coaching. Mentor 
coaching can entail choosing, 
with the teacher, one or two 
elements to focus on during 
the lesson. The observation 
might also be more general in nature - a pre¬ 
conference to establish what the lesson will 
cover, an observation, and feedback on what 
was done well and what might be done differ¬ 
ently. This can also be a good opportunity to 
discuss professional goals with teachers, 
whether those are in lesson design, lesson de¬ 
livery, professional development, or focused 
on some other standard. Teachers can share 
with the mentor the areas they would like to 
improve or develop, their implementation 
plans and how they will assess whether 
they’ve met their goals. 

A mentor coach can also use a more 
formal, comprehensive evaluation tool to ob¬ 
serve and discuss teachers’ strengths and 
areas for improvement, but it must be very 
clear that it will not become part of a teach- 


Feedback to teachers needs 
to be comprehensive, useful 
and specific. 


4 


ORTESOL Journal 




er’s summative evaluation. It is strictly for 
growth purposes. Mentor coaching, when 
done by the supervisor who will also be do¬ 
ing the summative observation and evalua¬ 
tion on the teacher, can help build trust, good 
communication, and credibility that is im¬ 
portant in effective supervisor evaluation. 

What happens during feedback is key 
to teacher growth. According to Rindler 
(1994), more important than the number of 
observations done by the mentor coach or 
supervisor is the time spent on the evaluation 
process. Teachers value and trust programs 
that allow for more time on evaluation and 
use that time well. Filling out lengthy forms 
or pulling together large portfolios only to 
have a supervisor briefly scan the material or 
make little or no effort to carefully examine 
and understand the contents is felt by teach¬ 
ers to be a waste of time (Rindler, 1994). 
Feelings of resent¬ 
ment, rather than 
openness to growth 
can result. 

Feedback to 
teachers needs to be comprehensive, useful 
and specific. Significant to teacher growth, 
according to Rindler’s study (1994) was the 
usefulness of suggestions provided, its basis 
in current research, and the specificity of the 
feedback. Also important to the impact on 
teacher growth was the credibility of the 
evaluator, the evaluator’s ability to model 
suggestions and the level of trust. As men¬ 
tioned earlier, having the evaluation focus on 
clear standards that are endorsed by the 
teacher had a significant impact on teacher 
improvement as well. 

Evaluators need to be well-trained 
and have good interpersonal skills (Darling- 
Hammond, 2012; Rindler, 1994). Mentor 
coaches and supervisors need to be well- 
versed in current second language acquisi¬ 


tion theory and practice to establish credibil¬ 
ity. They need to be good listeners to estab¬ 
lish trust. Mentor coaches and supervisors 
need to let teachers know specifically what 
was done well and offer specific ideas on 
what might be done differently based on the 
standards. Feedback should be given in writ¬ 
ing as well as discussed during conferencing. 
Coaches and supervisors also need to be able 
to point teachers to specific resources for 
making changes or improvements and help 
ensure that these are available to the teachers 
(Darling-Hammond, 2012). 

Student Appraisals 

Student appraisals, while important, 
cannot give a full picture of the effectiveness 
of a teacher. Many student appraisal forms 
don’t provide enough meaningful feedback 
for teachers to make effective changes in 
their teaching. Rindler (1994) reports that 
teachers found that a 
summary of students’ 
comments was more 
useful than bubbled-in 
responses. Research 
also suggests that sharing the results of the 
student appraisals with a trusted colleague or 
teaching consultant may increase “the degree 
of improvement” (Center for Teaching and 
Learning, University of North Carolina, 

1994, p. 3) in teacher effectiveness. Howev¬ 
er, relying solely on student appraisals for 
making high-stakes decisions is unsound. 
“Student ratings are often misinterpreted, 
misused, and not accompanied by other in¬ 
formation...” (Theall, 2002, p. 1). 

That is not to say that student ap¬ 
praisals shouldn’t be taken into account in 
evaluating a teacher. Students are in a unique 
position to report on teacher behaviors in the 
classroom and the frequency of the 
behaviors. They can report on the amount 
and difficulty of the work required for the 
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course, the usefulness of the materials used 
in the course, the effectiveness of the teach¬ 
er’s communication, the teacher’s availabil¬ 
ity and helpfulness outside of class, what 
they learned and whether they were satisfied 
with the course (Theall, 2002). Written ap¬ 
propriately, student appraisals do not merely 
indicate teacher popularity, but point to what 
makes a teacher popular. Effective appraisals 
address teacher behaviors. 

For student appraisals to be consid¬ 
ered useful, most researchers suggest that: 

• there should be no more than 25 items on 
the appraisal form. More than that and 
students could begin to experience fa¬ 
tigue (CTL, UNC, 1994, p. 2). 

• student appraisals should be anonymous. 

• the instructor should not be in the room 
when the appraisals are being done. 

• the instructor should not see end-of- 
semester appraisals until the term is over 
and grades have been given. 

• the facilitator should read the instruc¬ 
tions and the rating scale to students and 
answer any questions students may have 
about the appraisal and what the scale 
means. 

• the facilitator should point out open- 
ended comments sections and encourage 
students to answer these. 

• the facilitator should make clear that the 
appraisals will be used to help the teach¬ 
er improve the course. 

• students should be given sufficient time 
to complete the form; 20 to 30 minutes is 
usually ample time. 

Research suggests that a minimum of 
10 students is best for the data to be truly 
useful and that if less than 75% of the stu¬ 
dents complete the appraisal, one must be 
very careful in interpreting the data (CTL, 
UNC, 1994). Teachers should also be given 
the opportunity to respond in writing to 


student appraisals. 

Most importantly, data from student 
appraisals should be collected and summa¬ 
rized over time to get a broad view of stu¬ 
dents’ reactions to instructor performance 
and to help promote teacher growth (Felder 
& Brent, 2004; CTL, UNC, 1994). 

Teachers might also consider giving 
students mid-semester appraisals to help in¬ 
form their teaching. This could be done for¬ 
mally by having students answer open-ended 
questions on a form or by simply asking stu¬ 
dents from time to time to write a one- 
minute response to questions such as “What 
did you learn today?” or “What are you con¬ 
fused or unclear about?” These types of 
formative assessment can aid the teacher in 
improving instruction immediately rather 
than waiting for the end of the semester to 
make changes. 

Finally, student ratings should be ac¬ 
companied by other information (other types 
of evaluation and evidence) for summative 
evaluation of instructors and for faculty re¬ 
view. They should not be the sole form of 
evaluation. They cannot and do not provide a 
full picture of instructor effectiveness, but 
they should be part of the picture. 

Supervisor Evaluation 

Evaluation by a supervisor is usually 
considered part of summative evaluation, 
and indeed it is, but it doesn’t have to be 
limited to that role. Supervisors can act as 
mentors and participate in mentor coaching, 
as described above. Supervisors can confer¬ 
ence with teachers about goals and meeting 
the standards. They can observe teachers 
presenting warm-up activities or other in¬ 
structional activities rather than always ob¬ 
serving a complete lesson. Any observation 
should, however, be accompanied by a pre- 
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and post-conference to establish the objec¬ 
tives and share what was learned. 

Some teachers prefer to have super¬ 
visors visit their classes several times over 
the course of the year, not only to help their 
development as teachers, but so that the su¬ 
pervisor will get a fuller picture of the teach¬ 
er in action over several occasions. This, in 
turn, allows the supervisor to “take an aver¬ 
age.” 

It can’t be emphasized enough that 
teachers need to know 
whether an evaluation pro¬ 
cedure or tool is being 
used for summative or for 
formative evaluation. In 
both cases, teachers need to be familiar with 
the instruments being used. Formative eval¬ 
uation feedback should be kept by the teach¬ 
er for improvement and growth. Summative 
evaluation becomes part of a teacher’s pro¬ 
fessional record. Teachers should be told 
where it will be kept, who has access to it, 
and how it will be used. They should get a 
written copy and have the opportunity for 
written comments or rebuttals. 

Service and Professional 
Development 

Two important areas of teacher 
growth that are often included in an evalua¬ 
tion system are service to the institution or 
the profession and professional development 
activities. These affect both the teaching en¬ 
vironment and teacher performance. Most 
teaching standards include continuing edu¬ 
cation and service in their criteria for a good 
reason: teachers who serve on committees, 
develop curriculum, work on special pro¬ 
jects, present at conferences, and attend con¬ 
ferences and workshops stay current and are 
exposed to more ideas and possibilities to 
improve programs and their own teaching. 


Reports on engagement in service and 
professional development can be part of 
formative evaluation for identifying goals 
and later submitted as a report for summative 
evaluation and faculty review. Including 
reports on service and professional develop¬ 
ment as part of the teacher evaluation system 
gives teachers the opportunity to demonstrate 
that they are actively engaged in honing their 
skills and in gaining a broader understanding 
of the profession or institution. For supervi¬ 
sors, including these important elements in 
the evaluation system brings the topic to the 
table for discussion, which can be especially 
important when working 
with teachers who don’t or 
won’t participate in continu¬ 
ing education opportunities. 

Conclusion 

When reviewing faculty for determin¬ 
ing promotion, tenure, merit raises, awards, 
and dismissal, supervisors and review com¬ 
mittees should consider supervisor summa¬ 
tive evaluations, student end-of-term apprais¬ 
als, reports on service to the institution and 
the profession, and reports on professional 
development. 

Summative evaluation may also in¬ 
clude evidence collected and voluntarily sub¬ 
mitted by the teacher as indicators of the lev¬ 
el at which the teacher has met the standards. 
This might include: sample lesson plans with 
annotations; checklists or written comments 
from post-observation conferencing with 
peers or mentors; self-recorded videos of 
their teaching; student self-evaluations of 
their own progress; student pre- and post-test 
scores; samples of student projects; etc. 

These multiple measures help the supervisor 
and review committee get a fuller picture of a 
teacher’s effectiveness and level at which 
they are meeting the standards. 


Effective appraisals address 
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Teacher evaluation can be a very sen¬ 
sitive topic for teachers and program admin¬ 
istrators alike. Evaluations need to be fair 
and relevant to both teachers and programs. 
By including clear standards, opportunities 
and tools for various types of evaluations 
and evaluators, multiple measures, and fre¬ 
quent and useful feedback, language pro¬ 
grams can establish a productive evaluation 
system that supports learning and teaching 
and lays the groundwork for making good 
personnel decisions. 
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